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Abstract 

We study asymptotic behavior of the sums ZN,m{l3) determined by the 
formula 



where {A^™''} and are jointly independent random variables such that 

their laws do not depend on the subscripts. We assume that A^™'' take values 
{0, 1,2,.. .} and the mathematical expectations are E A*'"' = m and E 7) = 0. 
The random variable f''^\N,m) = -(/3m)"Mog Ziv,m(/3) can be regarded as 
the free energy of one more generalization of the Random Energy Model (REM) 
widely known in statistical mechanics. Imposing natural restrictions on the 
laws of A and r;, we prove existence of the limit = Yimm-^oo (2™, m) and 
obtain explicit expression for j'^-*. We study properties of f^^^ and compare 
our results with those obtained for REM and the Erdos-Renyi limit theorem. 

1 Introduction 

The Random Energy Model (REM) was proposed by B. Derrida [7] as a simplified 
version of the spin glasses (here the main reference is [15]). The statistical sum of 
REM can be represented by expression 

N n N n 
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where {rjij} are i.i.d. random variables with zero mean value Er; = 0. Under 
assumption that E e*'' exists, it was shown that in the limit n — > oo, A/' = 2" there 
is a critical value /3c that separates two different regimes of the asymptotic behavior 
of the free energy /C^) (TV, n) = - ^ log Z^AP) [7]- 

Almost at the same time, another model was considered [14], where (1.1) was 
assigned a meaning completely different from that of [7]. In [14] Zjv.„ represents the 
transparency of disordered layer in quasi one-dimensional case of quantum particles. 
Such a layer is composed of N threads of the length n, each thread contains a 
random number of obstacles. The particle goes along the thread and in the case 
of low enough energy of the particle, the probability of passing through the thread 
decreases exponentially with the distance. However, if one takes N exponentially 
large with respect to n, one can sec some of the particles hitting the other side of 
the layer. The number of such particles depends on the probability distribution of 
the obstacles. 

In papers [13, 14] this model has been rather deeply explored. Several asymp- 
totic expressions were obtained for various limiting approximations. In particular, 
the decrement of transparency f^^\N, n) was studied in [13] with N = e'". Assum- 
ing that the probability of large deviations of the sum rji^j is determined by a 
function <p, the authors of [13] derived an explicit expression for the limiting effective 
decrement f^^\q) in terms of (/>; 

/«(g)= iiif {</.(x)-4-g. (1.2) 

4>{x)<q 

More rigorous derivation of this formula was given in [19]. The resulting conclusion 
coming from (1.2) is that this model possesses a critical value Qcr, where f^^\q) 
changes its analytical structure. It is easy to see that Qcr = (pi^o), where xq is 
determined by equality (j}'{xQ) = 1. Certainly, Qcr is in one-to-one correspondence 
with (3c of [7]. 

Regarding the model of N threads of the length n [14], it is natural to ask what 
will happen in the case, when the length of the threads is distributed at random. In 
this paper we study this generalization of the REM. 

In Section 2 we describe the model and formulate results. In Section 3 we prove 
the main propositions and derive explicit expression for the free energy that general- 
izes (1.2). Relations between REM and the Erdos-Renyi limit theorem are considered 
in Section 4. In Section 5 we discuss critical values of q in our generalization of REM 
and describe some other generalizations of REM related to the version studied in 
present paper. 

2 The model and main results 

Let us consider the family A/^ = i, j € N} of independent identically distributed 
random variables determined on the same probability space Vt. We assume that 
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E rjij = and that there exists integral 

E e*"^'' = e^(*) <oo for all telC [0, oo), (2.1) 

where E = E denotes the mathematical expectation with respect to the measure 
generated by the family TV. We denote by (j){x) the Fenchel-Legendre (or Cramer) 
transform of <^(t) [8]; 

(p{x) = snp{xt — ip{t)}. 

t>o 

Let us also introduce a family C = {A^'"^ i,m € N} of independent random 
variables also independent from Af. We assume that these random variables take 
integer non- negative values and their distributions do not depend on i; 

Pv{X^^=l}=p'r\ Z = 0,1,2,... . 

We denote the mathematical expectation E by the same sign E . We assume that 
E A^"*' = m and there exists such a function x{t) that 

Ee*^r"' =e™>^(*)(i+°W\ as m^oo. (2.2) 
We denote ip{s) = supj>o{st — x{t)}- 

Theorem 2.1. Let us consider the normalized sum 

N A'-' 

ZnAP) = 1^ E n ^MPVij} (2.3) 



and determine random variable 



/(«(iV,m) = -^logZjv,„(/3). 
pm 

If Nq= [e^"*J, q> is the integer nearest to e'™, then with probability 1 

lim P\Ng,m) = f^^Hq), (2.4) 

m— >oo 

where the limiting f^^\q) is determined by relations 

F\q) = \ inf Mx)-M, (2.5) 



and 

u{x) = inf ^(y) + # ( - 

!/>o L \y 



(2.6) 
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Let us compare this result with those obtained for REM (1.2). First it should be 
noted that in each of these models the parameters /3 and q are almost equivalent. 
Indeed, if one divides both parts of (2.5) by /3, then one obtains (1.2) with q replaced 
by Pq. This means that to study the properties of the limit (2.4), we can restrict 
ourselves with /? = 1 and consider (cf. (1.2)) 

m= inf Mx)-x}. (2.7) 

i'{x}<q 

However, in (2.5) we prefer to keep these two parameters present in order to study 
the transition from REM to Erdos-Rcnyi partial sums (sec Section 4). 

The second observation that relates REM and Erdos-Renyi sums concerns func- 
tion i'{x) (2.6). It has already appeared [12] in the studies of the stochastic version 
of the ER limit theorem (sec relation (4.5) at the end of this paper). This transfor- 
mation can be regarded as a convolution of two functions ip{x) and ^(x). We study 
its properties in Section 4. Let us just note here that if one determines tp{x) as 

then expression in square brackets in (2.6) is determined for < y < 1 and in this 

case iy(x) = (t>(x). 

Finally, let us note that function ^{x) determines the probability of large devia- 
tions of the random variable 

i?i,m = (2.9) 

Representation of ^'{x) different from (2.6) can be found, for example, in [5, p. 52] or 
[16]. This reveals once more relations of the REM with the theory of large deviations 
[8] and makes hints to some other generalizations of REM (see Section 5). Certainly, 
appearance of the critical values (jcr in the both of the models (1.1) and (2.3) is due 
to the restrictions ^(x) < q and i'{x) < q, respectively. This is what makes the 
difference between REM and the standard theory of large deviations. 



3 Proof of Theorem 2.1 

We follow the reasoning of [19] modified along the lines indicated in [12]. Let us 
start with the estimate from below. It is clear that for any x > 



(3.1) 



N ■ 

i=l 1>1 
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where 1{A} is the indicator function of the event A C fl. The estimates of Z from 
above and below are based on the properties of i^{x) = ij,{N, m; x). So, let us study 
this variable in more details. 



3.1 Properties of fi 

Let us start with the average value of /x. Regarding independence of r] and A, we 
obtain equality 

E niN, m;x)=Y^ Pt{x\'^^ = /} . Pr J ^ rjij > mx \ = S{x). 

Applying to the last probability relation proved by Bahadur and Ranga Rao [1] , 
we can write that 

S{x) = J2p^^ exp{-m-</.(xy )(1 + o(l))}. (3.2) 



Let y' and 6 be such that v{x) = il>{y') + y'(t){x/y') and y' — 6 > x. The function 
y(j){x/y) is monotone and we can write inequality 



S{x) > fi"^ exp{-m^</.(xy )(1 + o(l))} > 

l>'m{y' —5) 

exp{-m(2/'-,5)<^(-^)(l + o(l))} Yl p'T^ = 

^ l>m{y'-S) 

eM-mW - ^) + [y' - ^)<^(^)(1 + 0(1))]}- 
Here we have used relation 

^ pirn) ^ g-m^(t)(l+o(l)) 
l>mt 

that follows from (2.2) by the Gartner-Ellis theorem (see e.g. [8]). Now it is easy to 
see that given e > 0, one can find such 5 that 

S{x) > e-'"''(^)(i+'^). (3.3) 

Prom another hand, inequality 

S{x) < e-™^(^)(i-^) (3.4) 

also holds. This follows from the observation that the sum in (3.2) is of the order of 
the sum 

Y pT^eM-m^^{^j){l + om< 

m{y' —5)<l<m{y' -\-5) 
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exp{-m(y' + '5)0(-7^)(l + E = 

exp{-™[^(y' -S) + (y' + <S)^(^^)](1 + o(l))}. 

Then (3.4) follows from continuity of the functions ^ and 0. Therefore, we can write 
that 

= e-™''(^)(i+''W) as m ^ oo. (3.5) 

Wc complete this subsection with computation of the variance of /i = ^,{N, m;x). 
It is easy to find that 

E,^-[Em1' = ->^ + >.5^(4 + ^), (3.6) 
where we denoted S = S{x). 

3.2 Estimates of Z 

Turning back to (3.1) and using (3.3), we can write that 

- log > - Mx) -Px} + - log (3.7) 

We have parameter x in our disposition to find the most precise estimate. The 
computations that follow will show that such an estimate is obtained when we take 
the minimal value of the sum F{x) = u{x) — j3x over x satisfying condition v{x) < q. 
Let us denote by x' the value of x that provides this minimum. 

Since we assume all functions entering (2.5) to be continuous, then for any given 
e > there exists such x < x' that x' — x > S for some S > and F{x) — F{x') < e. 
Then we derive from (3.7) that 

llogZ.,.(/3)>-F(^) + llogf|. (3.8) 



Now we turn to the estimate from above. To do this, let us first show that if x' 

3- 



is such that v{x') > q, then with probability 1 all random variables J^jLi Vi,j 



bounded by mx'. Indeed, denoting 



A= f] ^uj I'^rjij < mx' 



we can write that 



Pi{A) = [1 - Pr{^Vi,j > mx}]^ = [1 - S{x')f = [1 - e-'""^"') 
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Then our proposition follows and ZN,m{P) < e"^'^^ with probability 1. 

Let us cover the interval (0, x' — 6), where 5 is as in (3.8), by M intervals {ai,ai+i) 
of the length r/M, r = y{x' — 5) with ao = 0, am = r, we can write that 



M-1 N 



1=0 



M-1 



i=l 

M-1 



> < 



^ e"^"'/i(Af,m;a;) = ^ gm/3a,g-m..(a,)(l+o 



z=o 



i=0 

M-1 , . 

-minf,[i.(aO-/3o!](l+o(l)) ^^y'^l> 



(1)) M(«0 

5(az) 



< 



E 



/=0 



Siai) 



Combinig this inequality with (3.8), we can write that 



\-\0gZN,m{P)+F{x)\ < - log 

TO TO 



Ai max — - — - > . 

' Siai) J 



(3.9) 



The final remark concerns the difference — 1 that is small with probability 1. 
This follows from the estimate (3.6) and the observation that N = e^™ and NS{x) = 
^q-v{x) _ 0{e^™) as TO —> 00. Theorem 2.1 is proved. 



4 Relations with Erdos-Renyi limit theorem 

Let us rewrite definition (2.3) in the form 

1 ^ 

Z^M = -Y,e^^^^- , (4.1) 
1=1 

where are given by (2.9). The presence of the exponential function in the sum 
of (4.1) gives more weight to those terms that have maximal value of Ri^m- Then 
one can say that Z (4.1) represents an arithmetic mean of maximums of random 
variables e'^^'. 

Prom another hand, the maximum of arithmetic mean values of random variables 
is known in probability theory [10]. Namely, the sums 

n 

RP=Y.'^i+h i = l,2,...,N-n (4.2) 

i=i 

are referred to as the partial sums of A'' random variables ry,, and the limit theorem 
of Erdos-Renyi establishes existence of the limit 

lim max (ip(")\=7„, Af=|e«"J- (4-3) 

n^oo i=l,...,N-n [n ) 
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The limit 7 = 7, is such that (/>(7) = q [10], where 4> is determined by (/? (2.1) and 
one takes r]ij = rji+j [10]. If one replaces n by A-™^ and by m in (4.2) and (4.3), 
respectively, then one obtains random variables Ri^m that generalize partial sums 
(4.2). A result analogous to the Erdos-Renyi limit theorem can be proved for Ri^m- 
Namely, it is shown in [12] that the random variables 



XN,m — 



max 

=1,...,N 



/1r \ 

\m J 



(4.4) 



converges with probability 1 as m 
mined by relation 



00, = [e''"'J to a limit 7 = -fq{4>,tp) deter- 



inf 



ip{y) + ycj) 



= q- 



(4.5) 



Taking into account these results, it is natural to ask what is the model that 

interpolates two random variables: the statistical sum Zfq^miP) of REM (4.1) and 
the partial sums XM,m of ER limit theorem. It is easy to see that the random 
variable 

N 



-E 



(4.6) 



represents of the possible interpolations needed. 

Indeed, if k = m, then the random variable logYj^"^(/3) = ~(3f^^\N^m) con- 
verges to —lif^^\q) (2.4) as m — > 00. In the case of k » m one can expect 

^JVm *° ^® close to exj){XN,m{'l)}- In the general case, one can prove the following 
proposition. 



Theorem 4.1 

// one considers (4-6) in the limit fc,m — > 00 such that k/m a,k > m, then 
under conditions of Theorem 2.1 



limlogYAr,m(A;)(/3) = - inf 



fix 



l^{x)<q a 

where ^{x) is determined by relation (2.6). If k^ m, then 

hm logY^%i0) = - inf {-/3ar} = /3z/-i(g). 



(4.7) 



(4.8) 



We do not present the proof of Theorem 4.1 because it does not differ much from 
the proof of Theorem 2.1. 

The meaning of this theorem is very simple. When introducing k into (4.6), one 
changes the value of (3 in expression l/jSlogZ^^miP)- From this point of view, the 
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second limiting transition of Theorem 4.1 k/m — > oo corresponds to the limiting 
transition of (2.4) with m — > cx),/3 ^ oo. Certainly, this limit leads one to the 
maximum of partial sums of the Erdos-Renyi type; that is proved in Theorem 4.1. 

The Erdos-Renyi limit theorem is studied in many aspects (see, for example, 
[5, 6, 17] and references therein) and in a series of applications [3, 21]. Its relation 
with the REM can be useful in further studies. 

Let us study properties of function i'{x) (2.6). To do this, it is convenient to 
consider the simplest case 

fo, ifa;e(0,l), 
\a;(loga;-l) + l, ifa;e[l,oo) 

that corresponds to the Poissonian distribution of A^'"^ It is easy to see that v{x) 
is positive, monotone increasing function such that limj^^o = 0. 

Also, it is not hard to show that vix) < 4>{x) and 7 = i'~^{q) > <l>~^{q) = 7- This 
inequality can be easily explained by the observation that the presence of additional 
"randomness" in the sums (4.2) with respect to the sums (4.3) increases the value of 
the maximum in the Erdos-Renyi limit theorem. In this connection, it is interesting 
to study the difference between the critical values of q determined by (1.2) and (2.7), 
respectively. 



5 Discussion 

We have studied a version of the Random Energy Model [7, 13, 14]. The general- 
ization of (1.1) is to replace the given number n of factors by a random variable Aj. 
Let us describe here how this model arises from the original arguments presented 
in [4]. There (1.1) has been considered as the statistical sum of the polymer chains 
determined as branches of the Cayley tree. The energy of a chain is given by the 
sum of random weights along the corresponding branch. If the tree has the cardi- 
nality number K, then it is natural to consider (1.1) with = K". A version of the 
sparse random matrices has been proposed to describe this model. In this model, 
one considers the product of n matrices Bi of dimensions N x N; the matrices are 
such that there are exactly K non-zero elements in each line, and the positions of 
non-zero elements are chosen at random at each Bi. 

It should be noted that in random graph theory, another ensemble of sparse 
random matrices arises. Namely, the most studied model of the random graph is 
such that in a graph with N vertices [2], each edge is present with probability m/N 
or absent with probability 1 — m/N. In this case the adjacency matrix A of the 
graph is a real symmetric matrix of dimension N x N and each its clement above 
the diagonal is non-zero with probability m/N and zero with probability 1 — m/N; 
then {A)ij = aij,i < j are independent random variables such that 

(m.AT) _ / 1> with probability ^ , 
^ij ~ \ 0, with probability 1 - ^ • ^ ' 



9 



Obviously, in such a matrix the average number of non-zero elements per line is m. 

When regarding the model of polymer chains with matrices B replaced by A, one 
can easily see that the length of the polymer chain is given by a random variable. 
Thus, we obtain a generahzation of REM (1.1), where the parameter n is replaced 
by random variables Aj with mathematical expectation m. Since the fixed value of n 
is replaced by a random variable, the fluctuations of the energy are greater than that 
of the REM. This implies inequality i^{x) < 4>{x) mentioned at the end of Section 4. 
Then the limiting value of the maximum in the Erdos-Renyi limit theorem increases. 

It is natural to expect the critical value determined by (2.7) to be greater 
than Qcr- This conjecture can be supported by some particular cases of </> and ip 
with large values of /3. However, qcr in the general C3.S6j clS well as the properties of 
the convolution iy(x) are to be studied. 

Let us discuss two more generalizations of (1.1). The first one resembles the 
sparse random matrices [11] that also can be considered as a weighted adjacency 
matrices of a random graphs. One of the possible model here is obtained when the 
random variables Ri^m (2-9) are replaced by 



This generalization can be treated by the same way as it is done in Section 3. More 
interesting situation arises when one considers 



where {??j}jeN is a family of independent random variables (4.2). However, in this 
case Ri are correlated that makes analysis of corresponding free energy more difficult. 

As it is pointed out, in the case of jointly independent random variables Ri^m, the 
limiting expression (2.7) is determined by the fimction ^{x) controlling probability of 
large deviations oiRi^m- Therefore, if one replaces Ri^m by a family of TV independent 
random processes TZi{t), the crucial role in the limit t ^ oo, N = [e^*J will be played 
by their large values. It would be interesting to derive expressions analogous to (2.7) 
and determine the critical values of q in this model. 

At last, let us repeat that we have traced out relations between the limit theorem 
of REM with that of Erdos-Renyi. In fact, the corresponding result (see Theorem 
4.1) is familiar and almost evident to physicists. This is because the case when 
we obtain Erdos-Renyi expression from (4.1) corresponds to the limiting transition 
P —>■ oo that immediately leads one to the maximum of partial sums of random 
variables. Up to our knowledge, this correspondence has not been stated before in 
explicit form. The sums XliLi" e^^^ have been considered in [22] in connection 
with Erdos-Renyi limit theorem, but the limit /? — > oo has not been regarded there. 




m 
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